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PROFILE NORMALIZATION 
IN AN AUTONOMIC SOFTWARE SYSTEM 

BACKGROUND OF THE INVENTION 

Technical Field of the Invention 
[0001] The present invention generally relates to autonomic software systems. More 

specifically, the present invention is directed to an autonomic software system and method 
enabled to normalize a profile obtained from an executing application to account for actions 
applied by the autonomic system to the executing application after the profile is collected for 
improving the subsequent behavior of the application. 

Description of the Prior Art 

[0002] In an autonomic software system, decisions to "improve" an application are 

made online, i.e., as the application is executing. Specifically, the autonomic software system 
utilizes past application behavior during current application execution to predict future 
behavior of the application. Utilizing the predicted future behavior of the application, the 
autonomic software system may apply one or more actions (hereinafter "actions" will be used 
for simplicity) to the application to improve its future behavior. However, the autonomic 
software system is time sensitive with the following conflicting constraints: 1) deciding what 
actions to perform and performing those actions take clock cycles away from the execution of 
the application (the actions are performed while the application is executing); and 2) the 
longer the application executes before the actions are applied, the longer the application 
remains without the benefit of improvement. 

[0003] Typically, the autonomic software system utilizes profiling to determine the 

behavior of the application, subsequently utilizes profiling information to predict the future 
behavior of the application, and applies actions to improve the execution of the application. 
The actions that the autonomic software system considers applying to the application 
generally determine what profiling information the autonomic software system particularly 
needs to obtain. For example, profiling the number of times that a method is called by the 
application may be used by the autonomic software system to decide whether the method 
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should be inlined, i.e., replacing the call to the method in the body of the application with the 
actual statements of the method, thereby eliminating the call to that method and improving 
the application. As an additional example, profiling the time spent in a method of the 
application may be used by the autonomic software system to determine whether the method 
should be optimized. As a final example, profiling the communication between distributed 
objects may be used by the autonomic software system to determine which distributed objects 
should migrate between machines, thereby localizing often-invoked distributed objects to the 
machines from which they are invoked. 

[0004] As abovementioned, the autonomic software system can change the 

application's runtime characteristics through the actions that the autonomic software system 
applies to the application on the basis of profiling information (profile) obtained from the 
executing application. The applied actions may cause a change in the subsequent profiling 
information collected for the executing application. In this situation, regions of the code of 
the application changed by the application of the actions will take more or less time to 
execute and will appear more or less frequently in the subsequent time-based profiling 
information. However, the profiling information obtained from the executing application 
does not account for the actions applied by the autonomic system to the executing application 
after the profile is collected. Therefore, it is desirable to normalize a profile with respect to 
the actions applied by a autonomic system so that the effects of the applied actions are 
incorporated into the normalized profile to thereby allow the autonomic software system to 
make better decisions when either the normalized profile is compared to subsequent time- 
based profiles of the application's behavior after the actions have been applied or to 
determine the next best action to choose given a normalized profile. In contrast, if the profile 
is not normalized with respect to the actions applied by an autonomic software system, then 
the comparison of the profile with subsequent profiles between which actions have been 
applied may result in the autonomic software system making faulty decisions, which is not 
desirable. It is note be noted that other profiling techniques alternative to the time-based 
profiling are known and are applicable herein, 

[0005] For example, subsequent profiles may be compared to detect changes in the 

application's behavior. Changes in behavior of the executing application that are inherent to 
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the application are known as phase shifts. The design and structure of the application may be 
conceptualized as a series of phases, where the computation of the application proceeds from 
one phase to the other. For the autonomic software system, the detection of phase shifts as 
the application executes is important because the phase shifts may indicate different resource 
requirements. Unfortunately, if a profile is not normalized with respect to the actions applied 
by the autonomic software system to the executing application, the autonomic software 
system cannot determine if a change in the application's behavior is due to an inherent 
application behavior change or a change induced by the actions. Conventionally, a phase 
shift may be detected by comparing behavior of the executing application in several given 
time intervals during which a set of runtime events execute. If the behavior of each time 
interval differs by some significant amount then a phase shift may have occurred or be 
occurring. Otherwise, if the behavior does not differ substantially, the application may be 
executing in a steady state. However, where the behavior of the application is modified on 
the fly (i.e., online) as described above, it is more problematic for the autonomic software 
system to detect a phase shift because the application's behavior between the several time 
intervals may change because of the modifications made by autonomic software system and 
not due to a phase shift from one phase to another. 

[0006] Fig. 1 represents an illustration of a prior art autonomic system 100 that 

depicts the foregoing shortcomings of the prior art autonomic system. More specifically, in 
the prior art autonomic software system 100, an application is executed in a run time 
environment 102 via a profiling agent 104. The profiling agent 104 profiles the executing 
application 106 to generate a profile 1 10. The profile is transmitted to a prior art controller 
1 14 and phase shift detector 124. The controller 1 14 controls the timing of when the profile 
1 10 is collected via a control signal 108. It is noted that a plurality of profiles may be 
collected by the profiling agent 104, as directed by the controller 1 14 via the control signal 
108. Generally, the controller 1 14 comprises a behavior adjustor 116 that adjusts the 
behavior of the executing application 106 by applying one or more actions 1 12 to the 
executing application. It is noted that the behavior adjustor 116 may apply no actions to the 
executing application as will be discussed below. The behavior adjustor 116 comprises an 
analyzer 118, selector 120 and applicator 122. The analyzer 118 receives and analyzes the 
profile 110. More specifically, the analyzer 118 receives raw data via profile 110 and 



YOR920020048US1 



3 



transforms the raw data into a set of data that is utilizable by the controller 114. The set of 
data may include a sequence of basic blocks, pairs of method IDs and associated execution 
times, sequences of instruction cache misses, etcetera. For example, the analyzer 118 may 
analyze raw data, such as a plurality of method identifiers, and transform the raw data into 
canonical form, such as a weighted set of method identifiers where the weight of each method 
identifier equals the number of times the method identifier appeared in the raw data. The 
selector 120 receives the set of data from the analyzer 118 and selects one or more actions to 
be applied 1 12 to the executing application 106 that may help to improve the behavior of the 
executing application. In its determination, the selector 120 may use a cost-benefit model to 
determine if the cost of optimizing a method, represented by a method identifier for example, 
is less than the expected optimization benefit from a subsequent execution of the method, i.e., 
whether optimizing the method would improve the application's performance. The selector 
120 then transmits the selected one or more selected actions 112 actions to the applicator 122, 
which applies the one or more actions 1 12 to the executing application 106. It is noted, that 
the selector may select no actions based on the cost-benefit model, in which case the 
applicator 122 will not apply any actions. An article by Arnold, Mathew, et al. ("Adaptive 
Optimization in the Jalapeno JVM." Proceedings of the ACM Conference on Object- 
Oriented Programming Systems. Languages, and Applications Oct. 2000), discloses the 
foregoing example. During a subsequent predetermined time interval, the profiling agent 102 
may collect another profile 1 10 of the executing application 106 as controlled via the control 
signal 108. As is clear from the prior art autonomic system 100 of Fig. 1, the shortcoming of 
the autonomic system 100 is that neither the controller 1 14 nor the phase shift detector 124 
has the benefit of utilizing the profile 110 obtained from the executing application that 
accounts for the one or more actions 1 12 applied to the executing application 106, after the 
profile 1 10 is collected from the executing application 106, but before the subsequent profile 
is collected from the executing application 106 . 

[0007] Therefore there is a need in the art for providing an autonomic software system 

and method enabled to normalize or adjust a profile obtained from an executing application to 
account for one or more actions applied by the autonomic software system to the executing 
application after the profile is collected to improve the subsequent behavior of the executing 
application. 
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SUMMARY OF THE INVENTION 

[0008] It is an object of the present invention to provide an autonomic software 

system and method enabled to normalize a profile collected for an executing application to 
account for actions applied by the autonomic software system to the executing application 
after the profile is collected. 

[0009] According to an embodiment of the present invention, there is provided a 

method for normalizing a profile collected for an executing application to account for one or 
more actions applied to the executing application after the profile was collected, the method 
comprising: predicting an impact of applying the one or more actions to the executing 
application by utilizing the profile and the one or more actions; and adjusting the profile to 
form a normalized profile according to the predicted impact. 

[0010] According to another embodiment of the present invention, there is provided a 

system for normalizing a profile collected for an executing application to account for one or 
more actions applied to the executing application after the profile was collected, the system 
comprising: a predictor for predicting an impact of applying the one or more actions to the 
executing application by utilizing the profile and the one or more actions; and an adjuster for 
adjusting the profile to form a normalized profile according to the predicted impact. 

[001 1] According to yet another embodiment of the present invention, there is 

provided a method for adjusting a profile collected for an executing application to account for 
one or more actions applied to the executing application to improve detection of phase shifts 
in the executing application after the profile was collected, the method comprising: collecting 
a first profile for the executing application; predicting an impact of applying the one or more 
actions to the executing application by utilizing the first profile and the one or more actions; 
adjusting the profile to form a normalized profile according to the predicted impact; applying 
the one or more actions to the executing application; collecting a second profile for the 
executing application; and detecting a phase shift in the executing application by utilizing the 
normalized profile and the second profile. 
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[0012] According still another embodiment of the present invention, there is provided 

a system for adjusting a profile collected for an executing application to account for one or 
more actions applied to the executing application to improve detection of phase shifts in the 
executing application after the profile was collected, the system comprising: a profiling agent 
for collecting a first profile and a second profile for the executing application; a predictor for 
predicting an impact of applying the one or more actions to the executing application by 
utilizing the first profile and the one or more actions; an adjuster for adjusting the first profile 
to form a normalized profile according to the predicted impact; an applicator for applying the 
one or more actions to the executing application; and a phase shift detector for detecting a 
phase shift in the executing application by utilizing the normalized profile and the second 
profile. 

[00 1 3 ] According to a further embodiment of the present invention, there is provided 

a method for adjusting a profile collected for an executing application to account for one or 
more actions applied to the executing application to determine whether there is improvement 
in the execution of the executing application after the profile was collected, the method 
comprising: collecting a first profile for the executing application; selecting and applying one 
or more actions to the executing application; predicting an impact of applying the selected 
one or more actions to the executing application by utilizing the first collected profile and the 
one or more actions; adjusting the first profile to form a normalized profile according to the 
predicted impact; collecting a second profile for the executing application; evaluating the 
second profile against the normalized profile to determine whether there is expected 
improvement in the execution of the executing application; and applying one or more actions 
to undo the one or more actions applied to the executing application if there is no expected 
improvement in the executing application. 

[0014] According to yet a further embodiment of the present invention, there is 

provided a system for adjusting a profile collected for an executing application to account for 
one or more actions applied to the executing application to determine whether there is 
improvement in the execution of the executing application after the profile was collected, the 
system comprising: a profiling agent for collecting a first profile and a second profile for the 
executing application; a selector for selecting one or more actions to apply to the executing 
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application; a predictor for predicting an impact of applying the selected one or more actions 
to the executing application by utilizing the first collected profile and the one or more actions; 
an adjuster for adjusting the first collected profile to form a normalized profile according to 
the predicted impact; action evaluator for evaluating the second profile against the normalized 
profile to determine whether there is expected improvement in the execution of the executing 
application; and applicator for applying the selected one or more actions and one or more 
actions that undo the applied one or more actions if there is no expected improvement in the 
executing application. 

[0015] According to still a further embodiment of the present invention, there is 

provided a method for adjusting a profile collected for an executing application to account for 
one or more actions applied to the executing application to improve execution of the 
executing application after the profile was collected, the method comprising: applying a first 
selected action to the executing application based on the collected profile; predicting an 
impact of applying the first selected action to the executing application by utilizing the 
collected profile and the first selected action; adjusting the collected profile to form a first 
normalized profile according to the predicted impact; applying a second selected action to the 
executing application based on the first normalized profile or a subsequently normalized 
profile; predicting an impact of applying the second selected action to the executing 
application by utilizing the first normalized profile and the second selected action; adjusting 
the first normalized profile to form a second normalized profile according to the predicted 
impact; and repeating the applying, predicting and adjusting steps for the second normalized 
profile and every subsequently normalized profile and selected action. 

[001 6] According to a final embodiment of the present invention, there is provided a 

system for adjusting a profile collected for an executing application to account for one or 
more actions applied to the executing application to improve execution of the executing 
application after the profile was collected, the system comprising: a predictor for predicting 
an impact of applying a first selected action to the executing application by utilizing the 
collected profile and the first selected action; an adjuster for adjusting the collected profile to 
form a first normalized profile according to the predicted impact; and an applicator for 
applying the first selected action to the executing application based on the collected profile, 
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applying a second selected action to the executing application based on the first normalized 
profile and repeatedly applying each selected action from each subsequently normalized 
profile to the executing application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 7] The features and advantages of the present invention will become apparent to 

one skilled in the art, in view of the following detailed description taken in combination with 
the attached drawings, in which: 

[0018] Figure 1 illustrates a prior art autonomic system and depicts the shortcomings 

of the prior art autonomic system; 

[00 1 9] Figure 2 A illustrates an exemplary first embodiment of an autonomic software 

system that is enabled to normalize a profile collected from an executing application to 
account for the one or more actions taken by the autonomic software system after the profile 
is collected, according to the present invention; 

[0020] Figure 2B illustrates an exemplary second embodiment of an autonomic 

software system that is enabled to normalize a profile collected from an executing application 
to account for the one or more actions taken by the autonomic software system after the 
profile is collected, according to the present invention; 

[002 1 ] Figure 2C illustrates an exemplary third embodiment of an autonomic software 

system that is enabled to normalize a profile collected from an executing application to 
account for the one or more actions taken by the autonomic software system after the profile 
is collected, according to the present invention; 

[0022] Figure 3A illustrates an exemplary normalization performed by a normalizing 

controller in the foregoing three embodiments of the autonomic software system, according to 
the present invention; 
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[0023] Figure 3B illustrates another exemplary normalization performed by a 

normalizing controller in the foregoing three embodiments of the autonomic software system, 
according to the present invention; 

[0024] Figure 4A illustrates an exemplary method flowchart for the first embodiment 

of the autonomic software system; 

[0025] Figure 4B illustrates an exemplary method flowchart for the second 

embodiment of the autonomic software system; and 

[0026] Figure 4C illustrates an exemplary method flowchart for the third embodiment 

of the autonomic software system. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT OF THE INVENTION 

[0027] The present invention is directed to an autonomic software system and method 

enabled to normalize a profile obtained from an executing application to account for actions 
applied by the autonomic system to the executing application after the profile is collected for 
improving the subsequent behavior of the application. 

[0028] Figure 2A is an exemplary illustration of a first embodiment of an autonomic 

software system 200a that is enabled to normalize a profile collected from an executing 
application to account for the one or more actions taken by the autonomic software system 
200a after the profile is collected, according to the present invention. The autonomic 
software system 200a of the first embodiment comprises the following three main 
components: a profiling agent 104; a normalizing controller 202a; and a profile consumer 
(i.e., phase shift detector) 216a. The profiling agent 104 executes the application 106 in the 
runtime environment 102 and based on a control signal 108 from a normalizing controller 
202, the profiling agent 104 collects a plurality of profiles 110. More specifically, the 
profiling agent 104 collects each profile 1 10 of the executing application's 106 behavior 
during a predetermined time interval, as controlled via the control signal 108, and transmits 
the collected profile 1 10 to the inventive normalizing controller 202a as well as to the profile 
consumer 216a. A preferred predetermined time interval for collecting a profile 1 10 is ten 
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milliseconds. For example, a user timer interrupt may easily used to accomplish the 
collection of a profile during this predetermined time interval, or any other predetermined 
time interval as may need by particular user requirements. The profiling agent 104 may be 
implemented as instrumented code that is added to a source code of an application, which is 
compiled into the executing application 106, or by monitoring the execution of the executing 
application 106 in the run-time environment 102. 

[0029] Further with reference to Figure 2A, the normalizing controller 202a 

comprises a behavior adjuster 1 16 that adjusts the behavior of the executing application 106 
based on a collected profile 110. The behavior adjustor 116 comprises an analyzer 1 1 8, a 
selector 204a and an applicator 122. It is noted that the analyzer 118 and the applicator 122 
are similar to like components in the prior art Figure 1 . The analyzer 118 receives a profile 
110 collected by the profiling agent 104 during a predetermined time interval and produces a 
set of data that is utilizable in the controller 202ia as described above. The analyzer 1 1 8 then 
transmits the set of data to the selector 204a, which selects one or more actions 206 from the 
set of data to improve the behavior of the executing application 106. Lastly, the selector 204a 
transmits the one or more actions 206 selected from the set of data to the applicator 122, 
which applies the selected one or more actions 1 12 to the executing application 106. 

[0030] Still further with reference to Figure 2A, the normalizing controller 202a 

comprises a profile normalizer 208a that normalizes the collected profile 1 10 for use by a 
profile consumer (phase shift detector) as will be discussed below. The profile normalizer 
208a comprises a predictor 210 that utilizes the cost-benefit model described above for 
predicting an expected decrease in execution time of a particular method and an adjustor 212 
for adjusting or normalizing the collected profile 1 10 to produce a normalized profile 214 
according to the prediction. It is noted that the profile 110 (and a subsequent profile) 
collected by the profiling agent 104 from the executing application 106 is also transmitted to 
the profile normalizer 208a of the normalizing controller 202a. As depicted in Figure 2 A, the 
selector 204a of the behavior adjustor 1 16 is distinguished from the corresponding prior art 
selector 120 in that it not only transmits the selected one or more actions 206 to the applicator 
122 but it also transmits the selected one or more actions 206 to the predictor 210 of the 
profile normalizer 208a. Exemplary normalizations of a collected profile 110 via the profile 
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normalizer will be described in detail hereinafter with reference to exemplary Figures 3 A and 
3B. The predictor 210 of the profile normalizer 208a receives the collected profile 1 10 and 
one or more actions 206 selected by the selector 204a. The predictor 210 then utilizes the one 
or more actions 206 selected by the selector 204a to predict the behavior of the executing 
application 106 when the one or more actions 206 are applied to the executing application 
106 by the applicator 122, before a subsequent profile 1 10 is obtained from the executing 
application. As described above, the prediction involves a prediction of an expected decrease 
in execution time. The predictor 210 transmits the prediction result to the adjustor 212 that 
applies the prediction result to the profile 1 10 to thereby generate a normalized profile 214 
that is transmitted to a profile consumer (phase shift detector) 216a, which utilizes the 
normalized profile 214 and a subsequent collected profile to detect phase shifts in the 
executing application 106. As noted, in the autonomic system 200a, the profile consumer 
216a is a phase shift detector that detects phase shifts in the executing application 106. 
However, the profile consumer may be any other system component that can benefit from the 
normalized profile 216a. For example, the profile consumer may be an online visualization 
tool that graphically depicts how a normalized profile changes with respect to a subsequently 
collected profile and/or a current profile. Figure 2 A clearly depicts the advantage of the 
present invention in that the profile consumer 216a has the benefit of a normalized profile 
214 collected from the executing application 106 that accounts for the one or more actions 
applied 1 12 by the behavior adjustor to the executing application 106 before a subsequent 
profile 1 10 is collected from the executing application 106. The phase shift detector 216a 
receives a subsequent profile 110 and the normalized profile 214 and can more readily 
determine a phase shift in the executing application 106. The determination may be 
accomplished by comparing how similar the subsequent profile 1 10 is to the normalized 
profile 214. 

[0031] Figure 2B is an exemplary illustration of a second embodiment of an 

autonomic software system 200b that is enabled to normalize a profile collected from an 
executing application to account for the one or more actions taken by the autonomic software 
system 200b after the profile is collected, according to the present invention. In the second 
embodiment 200b it is assumed that the application 106 is executing in a steady state, i.e., no 
phase shift is occurring. Also in the second embodiment 200b, the profile consumer is an 
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action evaluator 216b for evaluating the one or more actions 206 selected by selector 204b, 
thereby fine-tuning the selector's 204b ability to determine the impact of the selected actions 
on the behavior of the executing application 106. The action evaluator 216b will be described 
in greater detail below. The behavior adjustor 116 comprises an analyzer 1 18, a selector 204b 
and an applicator 122b. It is noted that the analyzer 1 18 has the same functionality to that in 
the first embodiment 200a depicted in Figure 2A. The analyzer 1 18 receives a profile 110 
collected by the profiling agent 104 during a predetermined time interval and produces a set 
of data as described above. The analyzer 118 then transmits the determined set of data to the 
selector 204b, which selects one or more actions 206 from the set of data that will improve 
the behavior of the executing application 106. The selector 204b then transmits the one or 
more actions 206 to the applicator 122b that applies 1 12 the selected one or more actions 206 
to the executing application 106. In addition, the selector 204b also transmits the selected 
one or more actions 206 to the profile normalizer 208a and the profile consumer (action 
evaluator) 216b. The predictor 210 of the profile normalizer utilizes the one or more actions 
206 and profile 1 10 to predict the behavior of the executing application 106 when the one or 
more actions 206 are applied to the executing application 106 by the applicator 122b. The 
predictor 210 then transmits the prediction result to the adjuster 212 that applies the 
prediction result to the profile 1 10 to thereby generate a normalized profile 214 that is 
transmitted to the profile consumer (action evaluator) 216b, which utilizes the normalized 
profile 214. 

[0032] , Further with reference to Figure 2B, the operation of the profile consumer 
(action evaluator) 216b will be described in greater detail. As described above, the profile 
consumer 216b receives the one or more actions 206 transmitted by the selector 204b and the 
normalized profile 214 transmitted by the profile normalizer 208a. In addition, the profile 
consumer 216b receives the current profile 110 and all subsequent profiles 110 collected by 
the profiling agent 104 based on control 108 from the normalizing controller 202b. In the 
second embodiment 200b, it is assumed that the normalizing controller 202b via the behavior 
adjustor 116 has supplied one or more selected actions 206 and via the profile normalizer 
208a has supplied the normalized profile 214 to the profile consumer 216b, both for a current 
profile 1 10. It is further assumed that the one or more actions 206 for the current profile have 
been applied 1 12 by the applicator 122b to the executing application 106. At this point, the 
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normalizing controller 202b via the control signal 108 directs the profiling agent 104 to 
collect a subsequent profile 1 10 from the executing application 106. The processing for the 
subsequently collected profile 110 will now be described. The profiling agent 104 transmits 
the subsequent profile 1 10 to the normalizing controller 202b for processing as described 
above, and in addition transmits the subsequent profile 1 10 to the profile consumer (action 
evaluator) 216b. The action evaluator 216b evaluates the normalized profile 214 for the 
previously collected profile 1 10 against the subsequently collected profile 1 10 that reflects 
one or more actions 206 applied to the executing application 106 based on the previously 
collected profile 110. If the action evaluator 216b determines that the one or more actions 
206 applied based on the previously collected profile did not have the desired improvement 
effect on the executing application 106, the action evaluator 216b invalidates the previously 
applied one or more actions. The action evaluator 216b invalidates the one or more applied 
actions by transmitting an invalidate control signal 218 to the selector 204b to undo the 
previously applied actions 206. If an invalidate control signal is transmitted, the selector 
204b also updates its cost-benefit model so that the selector 204b does not choose the 
invalidated one or more actions again in processing future profiles 1 10 under the same 
circumstances as just described. A description will be provided below regarding the 
invalidation in the second embodiment 200b. 

[0033] Still further with reference to Figure 2B, below there is provided a description 

of an exemplary evaluation and invalidation performed by the profile consumer (action 
evaluator) 216b. For example, it is assumed that the action evaluator 216b has received a 
collected profile PI, actions, Al, applied to the executing application as a result of PI, and 
the normalized profile, NP1, where PI is normalized with respect to Al. After the actions Al 
are applied to the executing application, a subsequent profile, P2, is collected and transmitted 
to the profile evaluator 216b. It is further assumed that the executing application is in a 
steady state, i.e ? , a phase shift does not occur at this time. If P2 and NP1 are not similar then 
the selectors 204b (and the predictor's 210) understanding of how the actions, Al, would 
modify the executing application's behavior on the basis of PI was incorrect. The action 
evaluator determines one or more of the actions, Al, that correspond to the regions of P2 and 
NP1 that are dissimilar and invalidates these regions by transmitting an invalidate control 
signal 218 to the selector 204b and the predictor 210. The invalidate control signal 218 
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transmitted is preferably a tuple comprising <P1, NP1, A2, P2>, where actions, A2, maybe 
all of A 1 or a subset of A 1 . The selector 204b and predictor 210 update their cost-benefit 
models. On the basis of the invalidate control signal, the selector 204b selects actions, A3, 
and transmits the actions to the applicator 122b for application to the executing application 
106, thereby undoing actions, A2, that are to be invalidated. The selection of actions by the 
selector 204b to invalidate previously applied actions reflects whether that represents a net 
advantage to the executing application 106. For example, if an action was to optimize (i.e., 
compile) a method from optimization level 0 to optimization level 2, the action can be 
invalidated by recompiling the method at optimization level 0. On the other hand, if the cost 
of recompiling the method (recompilation time) is greater than the benefit of improved 
behavior (reduction in execution time), then the selector 204b will not have the applicator 
122b undo the action. 

[0034] Figure 2C is an exemplary illustration of a third embodiment of an autonomic 

software system 200c that is enabled to normalize a profile collected from an executing 
application to account for one or more actions taken by the autonomic software system 200c 
after the profile is collected, according to the present invention. In third embodiment 200c, 
the profile consumer is the normalizing controller itself 202c. The normalizing controller 
202c utilizes the normalized profile 214 so that the selector 204c can make better decisions as 
to what actions to select. More specifically, if the benefits of two actions are dependent then 
selecting the best action of the two and normalizing the profile before picking the next action 
from the normalized profile would better improve the behavior of the application. Two 
actions are dependent if the improved behavior of the application is less when both actions 
are applied than the combined improvement when each action is applied to the application 
separately. For example, if a profile indicates that two methods execute often, then the 
selector 204c might choose to optimize both methods;.howeyer, if one method is only 
executed when called from the other method and the other method inlines the one method, 
then the inlined method should not be optimized. 

[0035] Further with reference to Figure 2C, the normalizing controller (profile 

consumer) 202c comprises a multiplexer (i.e., "MUX") 220 that issues a control signal to the 
profiling agent 104 to collect a profile 110 from the executing application 106. The MUX 
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220 also provides a normalized profile to an analyzer 1 1 8c of the behavior adjustor 1 1 6 as 
will be described in greater detail below. The behavior adjustor 116 comprises the analyzer 
1 18c, a selector 204c and an applicator 122. It is noted that the applicator 122 has the same 
functionality to that in the first embodiment 200a depicted in Figure 2A. The analyzer 1 18c 
receives a profile 110 collected by the profiling agent 104 during a predetermined time 
interval, analyzes the data as described above and produces a set of data utilizable by the 
normalizing controller 202c. The analyzer 118 then transmits the set of data to the selector 
204c. Preferably, the selector 204c selects an action 206c from the set of data that will 
change and improve the behavior of the executing application 106. The selector 204c 
transmits the selected action 206c to the applicator 122 that applies 1 12c the selected action 
206c to the executing application 106. In addition, the selector 204c also transmits the 
selected action 206c to the predictor 210 of the profile normalizer 208c and the MUX 220 as 
will be described below. Alternately to the foregoing, the selector 204c may select no actions 
from the set of data produced by the analyzer 1 18c. If the selector 204c selects no actions, the 
selector 204c notifies the MUX 220 and the MUX 220 issues a control signal to the profiling 
agent 104 to collect a new profile 1 10 from the executing application 106. In addition, when 
the selector 204c selects no actions, the selector 204c transmits nothing to the applicator 122 
or to the predictor 210 of the profile normalizer 208c and the forgoing processing is 
performed for the new profile. 

[0036] Still further with reference to Figure 2C, if however, a selected action is 

transmitted from the selector 204c to the predictor 210 of the profile normalizer 208c, the 
predictor 210 utilizes the selected action 206c and profile 1 10 to predict the behavior of the 
executing application 106 when the action 206c is applied to the executing application 106 by 
the applicator 122. The predictor 210 then transmits the prediction result to the adjustor 212 
that applies the prediction result to the profile 1 10 to. thereby generate a normalized profile 
214 that is transmitted from the profile normalizer 208c to the MUX 220. When, the MUX 
220 receives the selected action from the selector 204c and the normalized profile 214, 
instead of instructing the profiling agent 104 to collect a new profile 1 10 from the executing 
application 106, the MUX 220 transmits the normalized profile 214 to the analyzer 1 1 8c and 
instructs the analyzer 1 1 8c to analyze the normalized profile 214. The analyzer 1 1 8c analyzes 
the normalized profile 214 and produces a set of data as described above. The analyzer 1 18c 
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then transmits the set of data to the selector 204c that either selects an action 206c from the 
set of data from the normalized profile 214 or selects no actions. If the selector 204c selects 
an action, the selected action 206c is transmitted to the applicator 122 that applies 1 12c the 
selected action 206c to the executing application 106. In addition, the selector 204c also 
transmits the selected action 206c to the predictor 210 of the profile normalizer 208c and the 
MUX 220. Alternately to the foregoing, if the selector 204c selects no actions from the set of 
data produced by the analyzer 1 18c, the selector 204c notifies the MUX 220 and the MUX 
220 issues a control signal to the profiling agent 104 to collect a new profile 1 10 from the 
executing application 106. In addition, when the selector 204c selects no actions, the selector 
204c transmits nothing to the applicator 122 or to the predictor 210 of the profile normalizer 
208c and processing described above is performed for the newly collected profile 110. The 
foregoing enables the normalizing controller 202c to account for successive actions applied to 
the executing application 106 before another profile is collected from the executing 
application 106. Stated another way, the normalizing controller 202c utilizes successively 
normalized profiles 214 to enable the selector 204c to make better decisions as to what 
actions to select 

[0037] Figure 3A is an exemplary illustration of the normalization 300a that may be 

performed by the normalizing controller in the foregoing three embodiments of the autonomic 
software system, according to the present invention. For the sake of clarity and brevity, a 
normalizing controller 302 represents any of the normalizing controllers 200a, 200b and 200c 
in the foregoing three embodiments, which are enabled to normalize a collected profile 110 
and generate a normalized profile 214. In the illustration 300a, the collected profile 1 10 
comprises a plurality of method and weight pairs. Let Pj be the profile 110 that is collected 

from the executing application 106 before one or more actions, A, are applied by the 
autonomic software system to the executing application 106. Furthermore, it is assumed that 
P 1 has profiled methods M y M 3 , and M 4 and that the weights profiled by the profiling 

agent 104 for these methods are 50, 10, 25 and 15, respectively, which total to the weight 100 
for the profile 1 10. Thus, applying the profiled weights to the profiled methods, profile ? x = 
{<M 15 50>,<M 2 ,10>,<M 3 ,25> and <M 4 ,1 5>} . Additionally, it is assumed that the one or more 
actions in A only affect the method M } and reduce its execution time (i.e., improving its 
performance) by 40%. Thus, applying the 40% percent reduction to the weight associated 
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with method M, profile p/ = {<M p 30>} (i.e., weight 50 - [weight 50 * 40% = 20] = 30). 
The weights for the other methods M v M 3 , and M 4 are adjusted according to the reduction for 
method M p which in effect increases their execution time proportionately to the reduction of 

execution time for method M } . More specifically, profile Pj 1 = {< M r 30>,< M 2 ,14>,< 
M 3 ,35> and < M 4 ,21>} . For example, the new weight for the method M2 is computed as 
follows. M 2 's initial weight is 10. The cumulative weight of all the unaffected methods 
M 3 and M 4 is equal to 50 (i.e., total weight 100-50 affected weight of method M } = 50 
unaffected weight for M 2 , M 3 and M 4 ). Therefore, 10/50 is 20%, and 20% of 20 (the 
reduction in Mj 's weight) is an additional weight 4, which is added to M^s initial weight to 
derive M 2 's new weight of 14. The same processing is performed for the other weights 
associated with methods M 3 and M 4 . Therefore, given a profile, P p that was collected over a 
predetermined time interval, T p and a set of one or more actions, A, that were applied by the 
autonomic software system after the profile was collected, P ) is normalized with respect to A 
by adjusting P } to reflect the application of A. 

[0038] Figure 3B is another exemplary illustration of the normalization 300b that may 

be performed by the normalizing controller in the foregoing three embodiments of the 
autonomic software system, according to the present invention. For the sake of clarity and 
brevity, the normalizing controller 302 represents any of the normalizing controllers 200a, 
200b and 200c in the foregoing three embodiments, which are enabled to normalize a 
collected profile 110 and generate a normalized profile 214. In the illustration 300b, the 
collected profile 1 10 comprises a plurality of basic blocks represented by integers. During the 
predetermined time period when the profile is collected, when a basic block in the application 
is executed, the basic block' s corresponding integer is written to the profile collected 110. 
Let P j be the profile 1 10 that is collected from the executing application 106 before one or 

more actions, A, are applied by the autonomic software system to the executing application 
106. Furthermore, it is assumed for this illustration that T> } has profiled the execution of basic 

blocks 1, 2, 3, 4, 5 as shown in Figure 3B. Additionally, it is assumed for this illustration that 
basic blocks 1, 2, and 3 make up a method, M, and an action, A, states that the method M 
should be optimized. The optimized method, M, consists of basic blocks 6 and 7. Thus, the 
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normalizing controller replaces the basic blocks 1, 2, and 3 in profile P with basic blocks 6 
and 7 in the normalized profile 214, as shown in Figure 3B. 

[0039] Figure 4A is an exemplary method flowchart 400a for the first embodiment of 

the autonomic software system 200a that is enabled to normalize a profile collected from an 
executing application to account for the one or more actions taken by the autonomic software 
system 200a after the profile is collected, according to the present invention. The method 
begins with step 402, where the profiling agent 104 executes an application 106 in the 
runtime environment 102. At step 404, the normalizing controller 202a controls the profiling 
agent via control signal 108 to collect a first profile 110. At step 406, the normalizing 
controller 202a analyzes the collected first profile 1 10 via the analyzer 1 1 8, determining a set 
of data that is utilizable in the normalizing controller 202a. Thereafter, at step 408, the 
normalizing controller 202a determines from the data whether to select one or more actions to 
apply to the executing application 106 or not to select any actions. If no actions are selected 
at step 408, the method continues at step 404, where another profile is collected from the 
executing application 106. Alternatively, if one or more actions are selected at step 408, at 
step 410, the applicator 122 applies the selected one or more actions to the executing 
application 106. At step 412, the profile normalizer 208a of the normalizing controller 202a 
normalizes the collected first profile 1 10. At step 414, the normalizing controller 202a 
instructs the profiling agent 104 to collect a second profile 1 10. Thereafter, at step 416, the 
phase shift detector detects a phase shift in the executing application using the normalized 
profile 214 obtained from the normalization of the first profile collected at step 404 and the 
second profile collected at step 414. As described above, a phase shift may be detected by 
comparing for similarity the normalized profile 214 to the second collected profile. 

[0040] Figure 4B is an exemplary method flowchart 400b for the second embodiment 

of the autonomic software system 200b that is enabled to normalize a profile collected from 
an executing application to account for the one or more actions taken by the autonomic 
software system 200b after the profile is collected, according to the present invention. The 
method begins with step 402, where the profiling agent 104 executes an application 106 in the 
runtime environment 102. At step 404, the normalizing controller 202b controls the profiling 
agent via control signal 108 to collect a first profile 1 10. At step 406, the normalizing 
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controller 202b analyzes the collected first profile 1 10 via the analyzer 118, producing a set of 
data to be utilized in normalizing controller 202b. Thereafter, at step 408, the normalizing 
controller 202b via the selector 204b determines from the set of data whether to select one or 
more actions to apply to the executing application 106 or not to select any actions. If no 
actions are selected at step 408, the method continues at step 404, where another profile is 
collected from the executing application 106. Alternatively, if one or more actions are 
selected at step 408, at step 410, the applicator 122b applies the selected one or more actions 
to the executing application 106. At step 412, the profile normalizer 208a of the normalizing 
controller 202b normalizes the collected first profile 1 10 to generate a normalized profile 214. 
Thereafter, at step 416, the normalizing controller 202b instructs the profiling agent 104 to 
collect a second profile 1 10. At step 418, the profile consumer (action evaluator) 216b 
evaluates the second collected profile against the normalized profile obtained from the first 
collected profile normalized at step 412. At step 420 it is determined from the second 
collected profile and the normalized profile whether there is an expected improvement. If 
there is an expected improvement at step 420, the method continues at step 424, where the 
normalizing controller 202b via the analyzer 118 analyzes the second collected profile to 
produce a set of data to be utilized in normalizing controller 202b. The method continues at 
step 408, where the selector 204b selects one or more actions from the set of data from the 
second collected profile. Thereafter, the method continues from step 408 as described above. 
Alternatively, if it is determined at step 420 that there is no expected improvement from the 
second profile 1 10 and the normalized profile 214, at step 422, the normalizing controller 
202b via invalidate control signal 218 instructs the selector 204b to invalidate actions applied 
to the executing application 106 at step 410, thereby undoing the applied actions as described 
above. At step 426, the cost-benefit model utilized by the selector 204b and the predictor 210 
is updated. Thereafter, the method continues at step 404 by collecting another profile 110. 

[004 1 ] Figure 4C is an exemplary method flowchart 400c for the third embodiment of 

the autonomic software system 200c that is enabled to normalize a profile collected from an 
executing application to account for the one or more actions taken by the autonomic software 
system 200c after the profile is collected, according to the present invention. The method 
begins with step 402, where the profiling agent 104 executes an application 106 in the 
runtime environment 102. At step 404, the normalizing controller 202c controls the profiling 
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agent via control signal 108 to collect a profile 110. At step 406, the normalizing controller 
202c analyzes the collected profile 1 10 via the analyzer 118, producing a set of data utilizable 
by the normalizing controller 202c. Thereafter, at step 409, the normalizing controller 202c 
determines via selector 204c from the set of data whether to select one action to apply to the 
executing application 106 or not to select an action. If no action is selected at step 409, the 
method continues at step 404, where another profile is collected from the executing 
application 106. Alternatively, if an action is selected at step 409, at step 41 1, the applicator 
122 applies the selected action to the executing application 106. At step 412, the profile 
normalizer 208c of the normalizing controller 202c normalizes the collected profile 1 10 to 
generate a normalized profile 214. Thereafter, at step 424, the normalizing controller 202c 
via the MUX 202 instructs the analyzer 118c to analyze the normalized profile 124, 
producing a set of data from the normalized profile in a manner described above. At step 
426, the normalizing controller 202c determines via selector 204c from the set of data 
whether to select one action to apply to the executing application 106 or not to select an 
action. If no action is selected at step 426, the method continues at step 404, where another 
profile is collected from the executing application 106. Alternatively, if an action is selected 
at step 426, at step 428, the applicator 122 applies the selected action to the executing 
application 106. Thereafter, at step 430, the profile normalizer 208c of the normalizing . 
controller 202c normalizes the normalized profile 214 to generate yet another a normalized 
profile 214. The method continues at step 424 and executes steps 424 - 430 until no further 
action is selected at step 426. Then, the method continues at step 404, collecting another 
profile 110 from the executing application 106. 

[0042] While the invention has been particularly shown and described with regard to 

a preferred embodiment thereof, it will be understood by those skilled in the art that the 
foregoing and other changes in form and details may be made therein without departing from 
the spirit and scope of the invention. 
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